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Abstract 

We report the occurrence of quenching and anneahng in a version of the 
Minority Game (MG) in which the winning option is to join a given fraction 
of the population that is a free, external parameter. We compare this to the 
different dynamics of the Bar Attendance Model (BAM)where the updating of 
the attendance strategy makes use of all the available information about the 
system and quenching does not occur. We provide an annealing schedule by 
which the quenched configuration of the MG reaches equilibrium and coincides 
with the one obtained with the BAM. 
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In recent times considerable attention has been given to the description of self- 
organization phenomena in multi agent models. These are geared to explain how (and 
which) individual decisions give rise to cooperative effects that show up in the behavior 
of the system as a whole. Such models have applications in a variety of situations that 
range from routing of messages in an information network to the way in which equilibrium 
is (dynamically) achieved by an ensemble of economic agents. 

A well known framework in this line of research is the Bar Attendance Model (BAM) 
proposed by B Arthur in In this model, N agents have to decide whether or not to go 
to a bar at a certain date. The customers share the perception that the attendance should 
not exceed a value n, n < N in order to avoid crowding. If the attendance is kept below 
that threshold, they derive a positive utility. As all the agents accommodate their individual 
attendance strategies seeking to increase their own utility, the whole system self-organises 
keeping the attendance at the required value. 

In recent times a simplified version of the BAM called the Minority Game (MG) has 
received much attention p|- .The main simplification is that agents derive utility whenever 
their choice coincides with that of the minority. This is equivalent to fix n in the BAM at 
n = {N — l)/2. The agents update their attendance strategies making use of information 
concerning the attendance of the previous days. 

Several variations of this model have been discussed in the literature. They essentially 
differ in the way in which the adaptation process takes place. We restrict ourselves to 
consider the probabilistic version of the Johnson et al. model ^ with a slight change in 
order to leave the accepted level of attendance n as an external free parameter. Each agent 
has a given strategy expressed by a probability pi {i = 1,2, N) to attend the bar. If her 
option is to go (not to go) and the attendance A is A < n {A > n), the agent gains a point. 
Otherwise, the agent looses a point. If her total number of points falls below a fixed negative 
threshold her account is reset to zero and her strategy pi is updated changing its value into 
one chosen at random in the interval {pi — Sp,pi + 6p). Refiective boundary conditions are 
used whenever necessary. The parameter Sp is kept fixed. If n = [N — l)/2 this framework 
coincides with the well known MG. 

The state of the many agent system is described by the density distribution P{p) that 
gives the fraction of agents that have a strategy within the interval {p,p + dp). Within the 
framework of the MG, an asymptotic Poo{p) is reached that displays a polarization of the 
population: essentially half of the agents always go to the bar while the other half never go 
thus keeping the average attendance close to A^/2 as expected. 

The evolution of the MG with n = n/N 1/2 has been studied by Johnson P| reporting 
that a situation can be reached in which no further updating of the strategies takes place 
and the distribution Pq{p) that is reached strongly differs from Poo(p)- In the present note 
we investigate this effect in detail. We prove that this is a situation in which the system 
is far from equilibrium. We also provide a prescription that can be followed to effectively 
reach equilibrium starting from a quenched configuration. 

We have performed extensive numerical simulations starting with an initial condition for 
P{p) in which all agents have a strategy p that is chosen at random in the interval (0, 1) 
with uniform probability. We have used several values of and changed fi above and below 
1/2. The overall behavior of the many agent system has been found to be nearly symmetric 
around = 1/2. Hence, we only show results for /j, > 1/2. 
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We find that if /i > /icr a quenclied distribution Pq{p) is readied. We establisli tliat 
quencliing lias occurred wlien no furtlier updating of strategies takes place. This naturally 
happens when all agents have more than a sizable number of positive points. In what follows 
most of our discussions assume that the prize for winning measured in units of the fine for 
loosing is G = 1. We explicitely remark when this is not the case. 

Some examples of Pq{p) are shown in Fig.|I]. It is worth to remark three features. First 
the value Pq{p) = for < p < 1/2 (or 1/2 < p < 1) , second that the width of the peak 
near p = 1/2 is only a function of 6p and third that the total attendance never reaches 
the required fraction /i. These features can qualitatively be understood. If one assumes 
that fi is large enough, agents face very different situations depending whether they have 
]9<l/2orp^l. In the first case the agents loose points frequently and therefore change 
their strategies constantly increasing the value of p. Those agents with p > 1/2 will instead 
seldom loose and their strategies are rarely updated. The attendance will therefore not 
increase significantly from the initial value and a quenched state is rapidly reached. 

The above arguments indicate that the shape of Pq{p) strongly depends upon the initial 
conditions. This is the reason why we prefer to call this effect "quenching" rather that 
"freezing". The latter suggests a new ordering that bears no relationship with the initial 
conditions, while the former indicates that a dynamics has been imposed that suddenly fixes 
the internal parameters of the system at values that are close to those corresponding to 
initial conditions and are far from equilibrium. 

Quenching starts to show up in a narrow region below a critical value ficr- The fact 
that this region becomes narrower for greater values of indicates that its existence is 
to be attributed to the fact that we are dealing with a finite number of agents. For the 
same reasons the values ficr also display some dependence upon N (see Fig H). These values 
become smaller (larger) if G is increased (diminished). 

The occurrence of quenching can also be investigated in the BAM. According to the rules 
of the BAM agents derive utility in two situations: one when they decide to go to the bar 
and A < n and when they decide not to attend the bar and A> n. The adaptive dynamics 
of the BAM has been studied with schemes either borrowed from genetic algorithms |Q 
1^ or bearing strong resemblances with that scheme. A purely probabilistic, mean field 
approach is however desirable to ease the comparison with the treatments of the MG. 

We suggest a dynamics that is based upon the same information as in the MG but uses 
it differently keeping track of the reasons for loosing or winning. We introduce "points" 
and "credits". Points are gained or lost if the option of attending the bar is correct or not. 
Credits are instead gained or lost depending whether the option of not attending the bar is 
correct or not. We therefore carry a double account: if an agent chooses to attend (not to 
attend) the bar and A < n {A> r;,)gains a point (a credit). Otherwise, she looses a point (a 
credit). When either the number of points or the number of credits falls below a negative 
threshold the corresponding account is reset to zero and the strategy is changed in the same 
fashion as already mentioned for the MG. 

Using the above dynamics we have obtained the asymptotic density distributions for 
various settings. We compare them with the ones obtained with the MG in Fig.|l]. Whenever 
11 < Her and no quenching is found in the MG, both distributions P^"^ and P^^^ can 
barely be distinguished from each other. In this regime while the distribution remains 
stationary individual strategies are continously updated and the level of attendance reaches 
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the accepted fraction fi. However if /i > ^cr the distribution P^'^^ip) is completely different 
to P^^{p) for the same settings. While in the MG no further updating of strategies takes 
place, strategies in the BAM continue to be updated at all times. In addition the density 
distribution has lost all memory of the initial conditions and displays a strong (asymmetric) 
self-organization: many agents attend the bar almost all the time, while a smaller fraction 
have a very small probability to go. 

It is possible to support these facts with a simple analytical discussion. We note that if 
all agents share the same strategy p, the probabilities 11^^ and IIc^ of winning respectively 
points and credits are given by 

U,,ip)=S{N,n,p) = J2{ . Wil-pf-'-' 

i=o \ * / 

UM = l-S{N,n + l,p) (1) 

for simplicity, we will write down the N and n dependence of Ilpt,cd only when necessary. 
In order to be quenched the probabilities Ilpt and Ilcd should both be greater than the 
probabilities of loosing respectively points and credits, namely, i.e. Upt > 1/2, and Ud > 1/2. 
This can clearly not be fulfilled simultaneously. Therefore agents either win points and loose 
credits or vice versa forcing an updating of their strategies p. 

A similar analysis can be made for the MG. If the system is prepared with a distribution 
Po{p) = S{p — Po) and G = 1 this will be quenched if the probability of winning Ilw{p) fulfills 

> 1 — n^^,, namely 

n^(Po) = Po^ptiPo) + (1 - Po)^cd{Po) > \ (2) 

the case for G ^ \ can easily be taken into account changing the r.h.s. of Eq.^ into 1/(1 + G). 

The situation for the MG is completely different than for the BAM. The function 
has a single maximum in the interval < p < 1. Furthermore, the curves n^t,(A^, n,p) fulfill 
n^(A^, n,p) ~ n^^,(A^, — n, 1 — p). Strict equality holds in the limit A^ — > oo, /i 7^ 0, 1. In 
Fig.^] we show an example of the functions S'(A^, n, p) and 11^ (p) for typical values of A^ and 
n, and yU > 1/2. 

For finite A^ and /i ~ 1/2 the value maxp^^,] = is less than 1/2 and no quenching 
occurs. For greater values of [i one can define a critical value /icr = ricr/N for which 
li^^ = 1/2 and quenching occurs. If one sets yU= 1/2, the value of fl^"^ is seen to approach 
the value 1/2 as A^ ^ 00 thus suggesting that an infinite agent system prepared with the 
initial conditions Pq{p) = 5{p — 1/2) is almost quenched, (see Fig. ^. 

Above iicr Eq.|] is fulfilled for any po in the interval limited by p< and p> that are the two 
roots of the equation Yiw{p) = 1/2. Any system prepared with a distribution Po{p) = 5{p—po) 
with Po within that region will rapidly be quenched i.e. will not change under the evolutive 
dynamics. 

It can be checked that the system evolves quite differently if the initial conditions are 
Po < p< or po> p>. In the first case the whole population of agents update their strategies, 
forcing all individual p's to surpass the value p<. Once this happens, updating stops and 
the system gets quenched with an attendance level below the accepted fraction /i. For 
Po > P> the asymptotic distribution P^'^ displays a strong (asymmetric) polarization, 
updating of strategies continues to take place continuously and the attendance reaches the 
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required fraction /x. We have checked numerically this with initial conditions of the type 
Po{p) = ^{p ~ Po)- Typical examples of the asymptotic distributions are shown in Fig.|^. 
Those that correspond to initial conditions with > p> are not distinguishable from those 
obtained with BAM for the same settings. 

The situations described hitherto indicate that outside a very restricted region of fi and 
for different initial conditions, the dynamics of the MG rapidly approaches quenching. The 
many agent system stops evolving, the attendance remains fixed at a value that is far from 
the tolerated fraction fi and all the other internal parameters remain close to the initial 
conditions. The results reported in can be seen to fall also in the framework presented 
here. 

Opposed to this, the BAM approaches always a distribution P^^^{p) that corresponds 
to what one expects of thermodynamics equilibrium: the attendance fluctuates around the 
expected fraction /i, all agents continue to update their individual strategies and P^'^^^ip) 
remains stationary. 

The way to regain equilibrium within the framework of the MG is through an annealing 
protocol geared to correct progressively the quenched distribution Pq{p)- The key point is to 
realize that quenching is produced by the memory stored in the points gained by the agents. 
In fact the quenched state remains fixed because there are no agents that ever loose points. 
We have implemented a procedure that consists in obliterating periodically the memory of 
the system by removing all the points gained by all the agents in each annealing episode. 

The results are displayed in Fig.ljfor the case /i = 85/101. At the end of the first episode 
the distribution P^{p) is entirely similar to those shown in Fig^ As agents are repeatedly 
deprived of points some are increasingly forced to update their strategies. Successive changes 
approach P^^^^{p). The way in which the annealing protocol works is shown in the inset of 
Fig.^. Quenching is checked by establishing that all agents have more than, say, 5 points. 
In addition we count how many steps are required to reach such quenched state. During the 
first 15 annealing episodes very few steps are required in order to have all the 101 agents 
with more than 5 points. After that moment the number of (quenched) agents that have 
more than 5 points starts to fall while the number of steps grows rapidly thus showing the 
occurrence of a greater number of individual updatings. After 40 episodes full equilibrium 
is reached and the number of steps saturates at the maximum allowed for each annealing 
episode. Throughout this process the attendance steadily grows approaching the required 
fraction of /i ~ 0.85. 

In the present note we have discussed how quenching occurs in the MG. The quenched 
state is far from equilibrium and strongly depends upon the initial conditions. This situation 
is a direct consequence of the dynamics for updating the individual attendance strategies. 
Contrary to this the BAM reaches a situation that can be thought as thermodynamic equi- 
librium. This difference has to be attributed to the fact the MG makes not full use of 
the (global) available information about the system while the BAM dynamics keeps instead 
track of the reasons for previous successes and failures. We also show how the quenched 
state can be brought back to equilibrium through an annealing protocol that amounts to 
periodically obliterate the memory stored in the system by removing all the points that have 
been gained by the agents. E.B. has been partially supported by CONICET of Argentina, 
PICT-PMT0051;H.C. and R.P. were partially supported by EC grant ARG/b7-30 11/94/27, 
Contract 931005 AR. 
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FIGURES 



FIG. 1. Asymptotic distributions Pg {p) for n = 70, 75, 80 and N =101 agents. Here /j^cr 
is 0.77. Results for /j, =70/101 for MG and BAM are essentially identical. The BAM results for 
H =80/101 are shown with few scattered open squares. These should be compared with the dashed 
curve obtained for the MG with the same settings. 

FIG. 2. The functions S{N,n,p) and Ilyj{p) for N =101 and =75/101. The MG asymptotic 
distributions obtained with initial conditions Po{p) = S{p — Po) with po =0.4, 0.7 and 0.9 are 
referred to the right axis. The results for po =0.9 for MG and BAM are essentially identical The 
intersections of Ilw{p) with the horizontal line at 1/2 are the two roots p< and p> 

FIG. 3. Plot of for /x =1/2 as a function of 100/A?^. We also show ^cr obtained for the 
initial condition of a uniform distribution 

FIG. 4. Density distributions P{p) obtained for the MG, and jj, = 85/101 after a annealing 
episodes. The values of a (1, 21, 50) are shown closed to the corresponding lines. The inital condition 
is a uniform distribution. Each annealing episode involves a maximum of 100000 updating steps, 
after which all the points winned by the agents are removed. In the inset we plot the variables 
that describe the whole process leading to equilibrium. 
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